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Goals of the course 


Understand the problems and methods in the field of Al. 
Get broader context of the field 


@ Understand the hipes and limitations 
e Understand the relation of Al to ML (CS) 
@ There is a very long way from a PoC to useful products 


@ etc. 
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What is Al? 


Britannica: Artificial intelligence (Al), the ability of a digital 
computer or computer-controlled robot to perform tasks commonly 
associated with intelligent beings. 

Merriam-Webster: 


@ a branch of computer science dealing with the simulation of 
intelligent behavior in computers 


@ the capability of a machine to imitate intelligent human 
behavior 


Me: Research field trying to solve problems easy to humans but 
(so far) difficult for computers - naturally changing a lot in time 
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Business perspective 


Artificial Intelligence is the Oil of 21 Century 


(Slide by Michal Pěchouček) 
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Business perspective 


Artificial Intelligence is the Oil of 21 Century 


e © total spent in Al by tech giants in 2016: $20B - $30B  McKinsey&Company 
» internal R&D 90% | » acquisitions 10% 

e © total spent in Al by startups in 2016: $6B - $9B 

e © total external investment in Al in 2016: $8B - $12B 


» 6096 machine learning 


*  Alspent: geographical distribution 
» S=66% |. E T | > 17% 


(Slide by Michal Pěchouček) 
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—oo — 1940: "Ancient" history 


long BC: Golem 


1495 Leonardo's mechanical knight 
Armor prforming human-like 
motrions trhough pulleys and 
cables 

1770 Mechanical turk 


Fake chess automaton 


1914 First actual chess-playing machine 
Endgame of rook--king vs. king 
1921 RUR 
Origin of the word "robot" 
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1940s 


1941 First electronic computers 
Z3, Atanasoff-Berry, Colossus 


1943 McCulloch&Pitts create the first model of artificial neuron 
1945 Alan Turing states that computers could play chess 
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1950s 


1950 Turing wrote the first chess program. 
1950 Claude Shannon published the fist paper on computer chess. 
1950 Turing proposed the Turing test. 


1956 Logic Theorist: Reasoning as heuristic search 


Eventually proved 38 of the first 52 theorems in chapter 2 of 
the Principia Mathematica 


1956 Dartmouth workshop 
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1950: Turing test 


Formalization of the question: Can machines think? 


The first variant was proposed in 1948 using Chess. Can a computer 
be programmed to be indistinguishable from a bad chess player? 


Official publication 


A. M. Turing (1950): Computing Machinery and Intelligence. 


MIND a Quaterly Review of Psychology and Philosophy, Vol. 59, 
No. 236., pp 433-460. 
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1950: Turing test 


TI 


9 Separates physical and intelectual capabilities 
@ Turing proposed variants 


e An interegator distinguishes between a human and a machine 
e She distinguishes whether the subjects is a human or a machine 
e (1952) A whole jury serves as the interrogator 


e The paper rebutts some of the main objections 
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2021: Turing test 


CAPTCHA: Completely Automatic Public Turing tests to tell 
Computers and Humans Apart 
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1956: Dartmouth workshop on “artificial intelligence” 


The proposal from 1955 used the term “artificial intelligence". 
9 "We propose that a 2 month, 10 man study of artificial" ... 
e Main topics: 


e Automatic computers e [heory of the size of a 

e How can a computer be calculation 
programmed to use a e Self-improvement 
language e Abstractions 


e Neuron nets e Randomness and Creativity 
Considered to be the founding event of Al as a research field. 
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1960s 


1961 Unimate, the first industrial robot for General Motors 
assembly line (video) 


1965 I.J. Good writes in “Speculations Concerning the First 
Ultraintelligent Machine” that “the first ultraintelligent 
machine is the last invention that man need ever make, 
provided that the machine is docile enough to tell us how to 
keep it under control.” 


1966 Eliza 
1966 Shakey the robot 
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1966: Eliza 


Weizenbaum, J. (1966). ELIZA — a computer program 
for the study of natural language communication between 
man and machine. Communications of the ACM, 9(1), 
36-45. 


Shows that a computer can hold 
a natural language conversation. 


Based on pattern matching with 

minimal permanent state. 
identifies keywords, discovers a 
minimal contex, chooses a 
transformation rule, generic 
response If no keywords 


Most famous set of conversation 
rules simulated a psychologist. 


Men are all alike. 

IN WHAT WA 

They’re always bugging us about something or other. 
CAN YOU THINK OF A SPECIFIC EXAMPLE? 

Well, my boyfriend made me come here. 

YOUR BOYFRIEND MADE YOU COME HERE? 

He says I’m depressed much of the time. 

I AM SORRY TO HEAR YOU ARE DEPRESSED. 

It's true. I am unhappy. 

DO YOU THINK COMING HERE WILL HELP YOU NOT TO BE UNHAPPY. 
I need some help, that much seems certain. 

WHAT WOULD IT MEAN TO YOU IF YOU GOT SOME HELP? 
Perhaps I could learn to get along with my mother. 
TELL ME MORE ABOUT YOUR FAMILY. 

My mother takes care of me. 

WHO ELSE IN YOUR FAMILY TAKES CARE OF YOU? 

My father. 

YOUR FATHER? 

You are like my father in some ways. 

WHAT RESEMBLANCE DO YOU SEE? 

You are not very aggressive 

but I think you don’t want me to notice that. 
WHAT MAKES YOU THINK I AM NOT VERY AGGRESSIVE? 
You don’t argue with me. 

WHY DO YOU THINK I DON'T ARGUE WITH YOU? 

You are afraid of me. 

DOES IT PLEASE YOU TO BELIEVE I AM AFRAID OF YOU? 
My father is afraid of everybody. 

WHAT ELSE COMES TO YOUR MIND WHEN YOU THINK OF YOUR FATHER? 
Bullies. 

DOES THAT HAVE ANYTHING TO DO WITH THE FACT 

THAT YOUR BOYFRIEND MADE YOU COME HERE? 


(O YOU O ME) => (WHAT MAKES YOU THINK I 3 YOU) 
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1966-1972: Skakey 


General-purpose mobile robot developed at 
Standord Research Institute 

Combined navigation, computer vision, 

natural language processing, etc. 
Programmed primarily in Lisp. General pur- 
pose planning using STRIPS. The project 
also introduced the A* algorithm and gen- 
eralized Hough transform. 
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1970s 


1972 WABOT-1, humanoid made in Japan 


Could walk, communicate in 
Japanese, grip and transport objects 


1972 MYCIN, an expert system to identify 
the source of infection and recommend 
antibiotics 

e Written in Lisp by Edward Shortliffe 

Knowledge base of ~600 rules 

“Fuzzy logic" evidence aggregation 

acceptability rating of 65% from a 

panel of specialist (humans achieved 

42.5% — 62.5%) 

Al adaptation is not only about 

performance 
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1974-1980: The First Al Winter 


Large drop of funding and interest in Al 


@ Initial hype did not deliver impactful 
applications 
e UK funding cut due to Lighthill report 
"In no part of the field have the 
discoveries made so far produced the 
major impact that was then 
promised” 
e DARPA focussed on "mission-oriented 
direct research" 


e Negative results of Minsky & Papert 


on perceptrons decreased popularity of 
connectionism 
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1980: Chinese room argument 


Strong Al: a computer is a mind, which can literally understand 
Weak Al: it simulates thoughts and only seem to understand 


Source: Wikicomms 


Searle argues against the possibility of strong Al. 


Searle, John. 1980a. “Minds, Brains, and Programs.” 
Behavioral and Brain Sciences 3, 417-424. 
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1980s 


1980 XCON, expert system selecting computer components 
Saved millions of dollars annually in deployment 

1980 WABOT-2, robot musician reads score and plays el. organ 

1981 $850 million Japanese “Fifth Generation Computer” project 
Supercomputer focused on parallel logical programming for Al 

1986 Driverless van drives 55 mph on empty streets of Bavaria 
Driving in public traffic since 1992, 1000s kms on highways 
Few other similar projects around the same time 

1988 Judea Pearl invented Bayesian networks 
Turing Award in 2011 

1989 recognising handwritten ZIP codes 
Yann LeCun et al. at AT&T using Neural Neworks 
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1987-1993: The Second Al Winter 


Large drop of funding and interest in Al 


@ The expert systems did not meet the 
expectations, they were too expensive 
to maintain 


@ Drop of market for specialized Al HW 
as general purpose HW became more 
powerful 


e High expectations / promises of many 
startups failed 
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1990 Brooks: "Elephants Don't Play Chess" 
Fast reactive behaviours for Al rather 
than hard symbolic manipulation 

1995 A.L.I.C.E., chatbot with large data 

samples from the internet 

1997 DeepBlue beats Kasparov 


Parallel Alpha-Beta search, 
evaluation function tuned on 
grandmaster games, openings 
database, endgames 


1999 AIBO 
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2002 i-Robot Roomba, comertially 
successful robotic vacuum cleaner 

2004 DARPA Grand Challenge: No one 
finished the 150 miles in a desert 


2005 DARPA Grand Challenge: Multiple 
successful teams 


Continued with few more challenges 


2009 Google develops driverless car (2014 
passed Nevada's test) 
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2010s 


2011 Watson 
2011 Siri 
2015 DQN in Atari games 
Reinforcement learning + Deep Learning 
2015 AlphaGo 
Monte Carlo tree search + Deep Learning 
2017 DeepStack 
CFR + Deep Learning 
2018 BERT followed by other language models 
Big Data + Deep Learning 3 
2019 AlphaStar 1x 


Reinforcement learning + Deep Learning IS 
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2010s: Al safety and fairness concerns 


Open Letter on Artificial Intelligence (2015): Stephen Hawking, 
Elon Musk, Russell, Norvig, Hassabis, Wozniak et al. 
Argues to focus on maximizing societal benefits of Al, e.g., Law and 
Liability, Ethics, Autonomous Weapons, Privacy, Verification, 
Control, etc. 


wick Bostrom Stuart Russell 


HUMAN 
COMPATIBLE 


2 
al 5 


Aland the Problem of Control 


Bias in Al: Amount of care in US hospitals, recidivism prediction, 
Amazon's hireing, gender stereotypes in language models, etc. 
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2021: Dall-E 


System for generating images from textual description trained from 
text-image pairs 


“an armchair in the shape of an avocado” 


44g 


“an illustration of a baby daikon radish in a tutu walking a dog” 


https: / /openai.com/blog /dall-e/ 


Viliam Lisy & Branislav Bošanský 


Al history take-aways 


Proof of concept is far from a viable product. 
The key ideas behind many recent breakthroughs are quite old. 


Hypes come and go. ML may be another one. 
Al history revolves around clear milestones. 
Deep Learning is great, but usually not enough. 


Al safety concerns are as old as the field. 


Better save than sorry. 
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Machine Learning 


A useful tool for Al, which is not a focus of this course 


Supervised learning = fitting a (high dimensional) function 


For a data set (xj, y;), find a Vo f 
function f that minimizes: » 

1 V3 

= F(x) — yj]. 

7 36 - Fl 


m Sb ap 3 
X X5 X3 X4 X2 


For example, (9) =2,f(3)=3,7(4) =4,F7( 5) =5. 
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Thinking fast and slow 


Humans have two main types of thinking: 
"thinking fast" and reflexive without much 
introspection and "thinking slow" based on 
internal models and predictions about the world. 


My analogy: 
Machine Learning — thinking fast 
Artificial Intelligence D thinking slow 


THINKING, 


FAST m SLOW 


E c 
DANIEL 


KAHNEMAN 
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Course organisation 


https: //cw.fel.cvut.cz/b202/courses/b4b36zui/start 
14 lectures leading towards some of the mentioned milestones 


3 programming homeworks in python evaluated by BRUTE 
Final written exam 
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Course grading 


https: //cw.fel.cvut.cz/b202/courses/b4b36zui /start 
30% for programming homework 


e 10% State space search (A*) algorithm 
e 10% Game playing bot 

e 10% Reinforcement learning 

e Extra tasks for additional point possible 


Each task must be submitted for > 50% of its points 
Deadline penalties: < 24h: -20%; > 24h: 0 
Plagiarism will not be tolerated! 

If you have serious issues let us know ASAP. 


70% for the final written exam 
in case of 804-96, also a brief oral exam 


Standard evaluation scale: https: //fel.cvut.cz/education/rules/Study_and-Exam_Code.pdf 
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Course Topics Overview 


Formal models of Al problems 

Search, A* 

Reinforcement Learning 

Two-Player Perfect-Information Games 
Logical Problem Representations 
Uncertainty in Al 


Sequential Decision Making with Limited Information 
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Course literature 


Slides are not study materials! 
@ Take notes. 
@ Artificial Intelligence: A Modern 


Approach (AIMA) by Stuart J. Russell 
and Peter Norvig (however, it is not free) 


@ Reinforcement Learning: An Introduction 
by Richard S. Sutton and Andrew G. 
Barto (PDF available online) 

@ Links on the courseware page 

@ Wikipedia 


/ jl 
Reinforcement / | 
L . d / 
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